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We compute the asymptotic temporal behavior of the dynamical complexity of the maximum 
probability trajectories on Gaussian statistical manifolds in presence of correlations between the 
macro- variables labeling the macrostates of the system. The algorithmic structure of our asymptotic 
computations is presented and special focus is devoted to the information geometric diagonalization 
procedure that allows to simplify the problem in a remarkable way. We observe a power law decay 
of the information geometric complexity at a rate determined by the correlation coefficient. We 
conclude that correlations lead to the emergence of an asymptotic information geometric compression 
Q\ • of the explored statistical macrostates on the configuration manifold of the model in its evolution 

between the initial and final macrostates of the Gaussian statistical model considered. 
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00 ■ I. INTRODUCTION 



The study of complexity [l[ has created a new set of ideas on how very simple systems may give rise to very complex 
behaviors. Moreover, in many cases, the "laws of complexity" have been found to hold universally, caring not at all for 
the details of the system's constituents. Chaotic behavior is a particular case of complex behavior and it will be the 
object of the present work. In this paper we make use of the so-called Entropic Dynamics (ED) Q and Information 
Geometrodynamical Approach to Chaos (IGAC) ED is a theoretical framework that arises from the combination 

of inductive inference (Maximum Entropy Methods^[5[ ) and Information Geometry [fj]. The most intriguing question 
being pursued in ED stems from the possibility of deriving dynamics from purely entropic arguments. This is clearly 
valuable in circumstances where microscopic dynamics may be too far removed from the phenomena of interest, such 
7-H ■ as in complex biological or ecological systems, or where it may just be unknown or perhaps even nonexistent, as 
in economics. The applicability of ED has been extended to temporally-complex (chaotic) dynamical systems on 
curved statistical manifolds and relevant measures of chaoticity of such an information geometrodynamical approach 
to chaos (IGAC) have been identified IGAC arises as a theoretical framework to study chaos in informational 
geodesic flows describing physical, biological or chemical systems. A geodesic on a curved statistical manifold Ms 
represents the maximum probability path a complex dynamical system explores in its evolution between initial and 
final macrostates. Each point of the geodesic is parametrized by the macroscopic dynamical variables {0} defining 
the macrostate of the system. Furthermore, each macrostate is in a one-to-one correspondence with the probability 
distribution {p(A|0)} representing the maximally probable description of the system being considered. The set of 
macrostates forms the parameter space T>q while the set of probability distributions forms the statistical manifold Ms- 
IGAC is the information geometric analogue of conventional geometrodynamical approaches @, Q where the classical 
configuration space Te is being replaced by a statistical manifold Ms with the additional possibility of considering 
chaotic dynamics arising from non conformally flat metrics (the Jacobi metric is always conformally flat, instead). It 
is an information geometric extension of the Jacobi geometrodynamics (the geometrization of a Hamiltonian system 
by transforming it to a geodesic flow Q). The reformulation of dynamics in terms of a geodesic problem allows 
the application of a wide range of well-known geometrical techniques in the investigation of the solution space and 
properties of the equation of motion. The power of the Jacobi reformulation is that all of the dynamical information 
is collected into a single geometric object in which all the available manifest symmetries are retained- the manifold on 
which geodesic flow is induced. For example, integrability of the system is connected with existence of Killing vectors 
and tensors on this manifold. The sensitive dependence of trajectories on initial conditions, which is a key ingredient 
of chaos, can be investigated from the equation of geodesic deviation. In the Riemannian 0] and Finslerian [f| (a 
Finsler metric is obtained from a Riemannian metric by relaxing the requirement that the metric be quadratic on 
each tangent space) geometrodynamical approach to chaos in classical Hamiltonian systems, an active field of research 
concerns the possibility of finding a rigorous relation among the sectional curvature, the Lyapunov exponents, and 
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the Kolmogorov-Sinai dynamical entropy (i. e. the sum of positive Lyapunov exponents) [To| . 

In this paper, using statistical inference and information geometric techniques, we investigate the possibility of 
studying the macroscopic behavior of suitable complex systems in terms of the underlying statistical structure of its 
microscopic degrees of freedom in the presence of correlations. We compute the asymptotic temporal behavior of 
the dynamical complexity of the maximum probability trajectories on Gaussian statistical manifolds in presence of 
correlation-like terms between the macrovariables labeling the macrostates of the system. We observe a power law 
decay of the information geometric complexity at a rate determined by the correlation coefficient. Correlations lead 
to the emergence of an asymptotic information geometric compression of the explored statistical macro-states on the 
configuration manifold of the model in its evolution between the initial and final macrostates. 

The layout of the paper is as follows. In the next Section, we briefly discuss some differences between statistical 
models in absence and presence of correlations. In Section III, we introduce the Gaussian statistical manifold in 
presence of non-trivial off-diagonal terms. We find the Ricci scalar curvature and the geodesic equations for such a 
system. In Section IV, we introduce the information geometric diagonalization procedure that allows to simplify the 
integration of the coupled set of nonlinear ordinary differential equations leading to the maximally probable trajectories 
of our model. In Section V, wc compute the asymptotic temporal behavior of the dynamical complexity of the geodesic 
trajectories for the correlated two-dimensional Gaussian statistical model. In Section VI, we outline the main steps 
leading to computation of the asymptotic temporal behavior of the dynamical complexity of geodesic trajectories for 
the correlated 2Z-dimensional Gaussian statistical model. Finally, in Section VI we present final remarks and suggest 
further research directions. 



II. STATISTICAL MODELS AND CORRELATIONS 



In this section, we introduce the notion of statistical models (manifolds) in absence and presence of correlations 
between the microscopic degrees of freedom of the system (microcorrelations) or between the macroscopic variables 
labelling the macrostate of the system (macrocorrelations) in its information-constrained evolution on the statistical 
configuration manifold. For the sake of simplicity, we focus our attention on Gaussian statistical models. 



A. Gaussian Statistical Models without Correlations 



Consider a Gaussian statistical model whose microstates span a /-dimensional space labelled by the variables 



I. We assume the only testable information pertaining to the 
and the variance Axj. The set of these expected values define 



{X} = {#1, X2,..., x{\ with Xj <E R, Vj = 1,. 
quantities Xj consists of the expectation values 
the 2Z-dimensional space of macrostates of the system. A measure of distinguishability among the macrostates of 
the Gaussian model is achieved by assigning a probability distribution P (X\Q) to each 2/-dimensional macrostate 

= f { (^OjS^Qj) } ; pairs = {(( x j) > Ax.,) } ; _ pairs - The process of assigning a probability distribution to each state 



provides Ms with a metric structure. Specifically, the Fisher- Rao information metric (0) [6( is a measure of 
distinguishability among macrostates on the statistical manifold Ms, 



9»u (6) 



J dXP{X\Q)d IJi \ogP{X\@)d u \ogP{X\Q) = A J dXd^p(X\Q)d v ^p(X\Q), 



(1) 



with /x, v — 1,..., 21 and <9 M = ^77- It assigns an information geometry to the space of states. The information 
metric g^ (0) is a symmetric and positive definite Riemannian metric. For the sake of completeness and in view of 
its potential relevance in the study of correlations, we point out that the Fisher-Rao metric satisfies the following 
two properties: 1) invariance under (invertible) transformations of microvariables {x} € X; 2) covariance under 
reparametrization of the statistical macrospace {9} € T>g. The invariance of g^ v [&) under reparametrization of the 
microspace X implies that Q, 



p{x\6) 



X C M' 9 x 1 — ► y = / (x) £ y C R< p (x\0) 1 — > p' (y\0) 

21 

The covariance under reparametrization of the parameter space T>g (homeomorphic to Ms) implies that Q, 



1 



(2) 



Vg3 9^e' d ^ f (9) e Vg. 9ltu (9) .— > g' (6') 



d9 a de fJ 

86"* d9 w9afi { ) 



e=f- 1 (e>) 
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where, 



9^ (<?') = / dxpf (x\9') ff^ogp' (x\0') d v \ogp' (x\9') 



(3) 



with d' = QfiTjr and p' {x\9') = p (x\9 = f^ 1 (#')) . Our 2/-dimensional Gaussian statistical model represents a 
macroscopic (probabilistic) description of a microscopic /-dimensional (microscopic) physical system evolving over 
a /-dimensional (micro) space. The variables {X} — {x\ 1 X2,---, x{\ label the /-dimensional space of microstates of 
the system. We assume that all information relevant to the dynamical evolution of the system is contained in the 
probability distributions. For this reason, no other information is required. Each macrostate may be thought as a 
point of a 2/-dimensional statistical manifold with coordinates given by the numerical values of the expectations 
and ^ 2 '0j. The available relevant information can be written in the form of the following 21 information constraint 
equations, 



dxjXjPj \Xj\^ ^Oj^ H 



, Axj = 



d Xj (xj - {xj)f P 3 (x^Qj^Qi 



(4) 



The probability distributions Pj in are constrained by the conditions of normalization, 



= i. 



(•5) 



Information theory identifies the Gaussian distribution as the maximum entropy distribution if only the expectation 
value and the variance are known [ll|. Maximum relative Entropy methods [E[[l2,[l3[ allow us to associate a proba- 
bility distribution P (X\Q) to each point in the space of states 0. The distribution that best reflects the information 
contained in the prior distribution m(X) updated by the information ({xj) , Axj) is obtained by maximizing the 
relative entropy, 



5(9) = - / d l XP (X|0)log 



P 



(x\e) \ 

m (X) J ' 



(6) 



where m (X) is the prior probability distribution. As a working hypothesis, the prior m (X) is set to be uniform since 
we assume the lack of prior available information about the system (postulate of equal a priori probabilities) . Upon 
maximizing |6]). given the constraints ((4J and ([5|), we obtain 



p(x\9) = Y[p j (x j \We jt <-% 



(7) 



where 



exp 



( X 3 -VjY 

2a) 



(8) 



and, in standard notation for Gaussians, ^Wj 



del' 



del' 



Axj = o~j. The probability distribution (J7]) 



encodes the available information concerning the system. The statistical manifold Ms associated to is formally 
defined as follows, 



M s = \p(x\e) = l[p j (x j \n j , 



(9) 



where X £ M. 1 and belongs to the 2/-dimensional parameter space 2?e = xl a ] . The parameter space T>q 
(homcomorphic to Ms) is the direct product of the parameter subspaces I M and 2 a , where (in the Gaussian case, 
unless specified otherwise) = (— oo, + oo)^ and T a = (0, + oo) CT . The line element ds 2 = (0) dO^dO" arising 
from © is [3, 



ds 



M s 



J = l 



J2 d(J i 



with fj,, v = 1, 



21. 



(10) 
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Note that we have assumed uncoupled constraints among microvariables Xj. In other words, we assumed that infor- 
mation about correlations between the microvariables need not to be tracked. This assumption leads to the simplified 
product rule ([7|). 



B. Gaussian Statistical Models with Correlations 



Coupled constraints would lead to a "generalized" product rule in ([7]) and to a metric tensor ([T]) with non-trivial 
off- diagonal elements (covariance terms). In presence of correlated degrees of freedom {x^}, the "generalized" product 
rule becomes, 



(ii) 



where, 

P t ' ot (xi,..., Xj) = Pj (Xi|xi,..., X;_i)P_i (xj_i \xi ,.. ., X/_ 2 ) ...Pa (x 2 |xi)pi (x x ) . (12) 
For instance, correlations in the degrees of freedom may be introduced in terms of the following information-constraints, 

Xj = fj (xi,..., Xj-i) , Vj = 2,..., J. (13) 

In such a case, we obtain 

^tot (^li— i x/) =6(xt- fi (xi,..., X;_i)) (5 (x/_i - (xi,..., x/_ 2 )) -S (x 2 - / 2 (xi)) Pi (xi) , (14) 
where the j-th probability distribution Pj (xj) is given by, 



Pj ( x j) = J ■■■ J dxi...dxj-idxj +1 ...dxiP{ ot (xi,..., x/) . 



(15) 



Correlations between the microscopic degrees of freedom of the system {xj} (microcorrelations) are conventionally 
introduced by means of the correlation coefficients r 



(micro) 
ij 



f \ def \XiXj) \Xi) \Xj) 
r[Xi, Xj) = — ! , With 0~i 



CJiCF 4 



(Xi - (Xi))' 



(16) 



(micro) 



G ( — 1, 1) and i, j = 1,..., I. For the 2/-dimensional Gaussian statistical model in presence of microcor- 



with r 

relations, the system is described by the following probability distribution P (X\Q), 

i 

■ exp 



P(X|0) = 



1 



2tt)' det C (9) 



-\{X- M)* • C- 1 (9) • {X - M) 



^\{(2rf) 5 exp 



2a? 



(17) 



where X = (xi,..., x;), M = and C (9) is the (21 x 2Z)-dimensional (non-singular) covariance matrix. 

As a first step in studying the introduction of some sort of correlations into statistical models, we will focus on 
the relatively simple (but non trivial) model introduced in the following paragraph. In principle, the computational 
techniques introduced in this article would be valid for arbitrary complex statistical model in presence of correlations. 
Additional difficulties arise purely from a computational point of view. 



III. THE TWO-DIMENSIONAL MACRO-CORRELATED GAUSSIAN STATISTICAL MODEL 



We study the information dynamics of a system with I degrees of freedom, each one described by two correlated 
pieces of relevant information, its mean expected value and its variance (Gaussian statistical macrostates in presence 
of macro-correlations). The line element ds 2 = (9) dQ^dQ" onM s that we consider is defined by, 

ds 2 Ms = f ^ ( —dfi 2 H — '-YdfijdcTj H ^da 2 ] , with fi, v = 1,..., 21. (18) 
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We consider positive coefficients rj £ (0, 1), Vj = 1,..., I and we assume they play the role of correlation-like 
terms between the macrovariables labelling the macrostates of the system under investigation (macro-correlations). 
This leads to consider a 2Z-dimensional statistical manifold A4 S where the probability distributions representing 
the state of the system show deviations from standard Gaussian probability distributions due to the introduction 
of nonvanishing coefficients r k . We believe the study of this relatively simplified model constitutes an important 
preliminary step towards the computation of the asymptotic behavior of the dynamical complexity of microscopically 
correlated multidimensional Gaussian statistical models. In particular, it improves our understanding of the effect 
of correlations in the behavior of the complexity of maximally probable trajectories of statistical models used to 
characterize systems in a probabilistic way. For the sake of clarity, we will first consider the two-dimensional Gaussian 
model with non-trivial off-diagonal terms. Then our formalism could be generalized in a straightforward way for the 
2Z-dimcnsional statistical manifold. We will discuss this in Section VI. 



A. Information Geometry of the two-dimensional Model 



Consider the information dynamics of a system with I = 1 microscopic degree of freedom described by two correlated 
pieces of relevant information, its mean expected value and its variance. The Fisher-Rao line element ds 2 of such 
statistical model Ai s is given by, 

ds 2 Ms d = gij (6) d9 l d9 3 = -^dfi 2 + ^dfida + -^da 2 , with i, j = 1, 2. (19) 

The Fisher-Rao metric tensor </y (/i, a) leading to the line element in ()19|) is given by, 

9lj (n, cr) = -Jj g J • (20) 

Therefore, the inverse metric tensor (/z, cr) becomes, 

^ *) = 2^ ( -r 7 ) ■ ( 21 ) 

The metric tensor (//, cr) and its inverse g lj (tt, cr) are useful quantities for the computation of the Christoffel 
connection coefficients Ij„- of the curved statistical manifold (model) Ai s . Recall that the connection coefficients T% 
are defined as [151 ]. 

pfe dcf l gkm { ^ + _ d ^ ) _ (22) 

In our case, we have to compute the six connection coefficients T^, T 2 2 , T 2 2 , T\ 1: F\ 2 , ^22- Substituting (|2"0)) and 
(j2~Tj) in ([22]), we obtain, 

r 2 _ 1 '■ F 2 _ r 2 _ r ■'• r 2 _ ^ I 

(23) 

r 1 - r 1 -r 1 - 2 1 r 1 - 2r 1 

1 11 — U, 1 12 — 1 21 — „ 2 ' 22 — o 2 

2 — H (7 2 — H (7 

Notice that in the limit r — > 0, we get the Christoffel connection coefficients for the two-dimensional Gaussian 
statistical model in absence off-diagonal matrix elements in g^ (/i, cr) [l||. Once obtained the non- vanishing T^ , we 
compute the Ricci curvature tensor IZij defined as [ll|, 

Ha ^ d k v% - a,i* + r£„ - r™r* m . (24) 

Substituting (|23p in (|24| . we obtain the three non- vanishing IZij components, 

2 1 4 1 

72.11 = ,^r, 7^12 = 0, U 2 2 = 2^7- ( 25 ) 

{2-r 2 ) 2 ^ 2 {2-r 2 fo 2 
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Again, notice that in the limit r — > 0, we get the standard Ricci tensor components in absence of correlations-like 
terms in the Gaussian model. Finally, we compute Ricci scalar curvature TZmsi 

n Me =n ijg ij . (26) 

Substituting (gH and (J2EJ) in (|26|). 7£m s M becomes, 

(r) = ^ ll3 n + ^ 225 22 = -8 (2 - r 2 )~ 3 . (27) 
In absence of correlations, r — ► 0, we recover the known relation 7?.» s = — 1- 

B. Information Dynamics on .Ms 

The information dynamics can be derived from a standard principle of least action of Jacobi type [2J ■ The geodesic 
equations for the macrovariables of the Gaussian ED model are given by nonlinear second order coupled ordinary 
differential equations, 

The geodesic equations in (|28[) describe a reversible dynamics whose solution is the trajectory between an initial 
Q(imtiai) anc j a g na i macrostate 8( final ). The trajectory can be equally well traversed in both directions. In the case 
under consideration, substituting (|2"5|) in l[2"8"|) and noticing that 6 1 = n, 6 2 = a, the geodesic equations become, 

d 2 n _ 4 1 dfi da _ 2r 1 ( da_\ 2 _ n 
17 1 2-r 1 a dr dr 2-r 2 a \ dr J U ' 

(29) 

d 2 a , 1 1 / dfj_\ , 2r 1 dp da _ 2 1 (da) 2 _ ri 
dr 7 2-r 2 cr I dr I ' a dr dr 2-r 2 a \ dr ) u ' 

Integration of the coupled system of nonlinear second order ordinary differential equations in (|29p is highly non trivial 
while this system can be solved in the case r = 16]. Therefore, in what follows we will introduce an information 
geometric diagonalization procedure that allows us to tackle such problem in a more convenient way. 

IV. INFORMATION GEOMETRIC DIAGONALIZATION PROCEDURE 

In this Section, we introduce the information geometric diagonalization procedure that allows to simplify the 
integration of the coupled set of nonlinear ordinary differential equations leading to the maximally probable trajectories 
of our Gaussian statistical model in presence of non trivial off-diagonal terms in the Fisher- Rao information metric. 

A. Preliminaries 

Consider the 2x2 matrix representation of an arbitrary Fisher- Rao information metric tensor g in its basis £> id, 

r-i _ ( 9(di, dr) g(d u d 2 ) \ r „ m 
[9lB ^-\g(d 2) dr) g(d 2 ,d 2 ) )> 

The set Bold = f {dr, d 2 } with (in our case) dr = = d^ and d 2 = ^ = d a is a basis for the tangent space at 
p € T p (M s ) 1 where M. s is an arbitrary two-dimensional curved statistical manifold. An arbitrary vector in the 
tangent space T p (M s ) can be written as, 

e = fid^ + ad a . (31) 

Recall that all non-singular matrices induce a basis transformation in T p (M s ). For instance, consider the following 
change of basis, 

Sow = f {0i , d 2 } — > B ncw d ^ f { dr , B 2 } , (32) 
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with di = Jt- and d 2 = -§g- Suppose we have, 

'■!<>,■ (33) 

where Ef is a 2 x 2 non singular matrix of real numbers describing the basis transformation. A change of basis induces 
a change of the components of a vector 9 in the tangent space T p (M. a ). Assume that di — Ejdj is a general basis 
transformation at p and let 9 = 9*<9i — Q l di define the components of a vector 9 with respect to the two bases B \a 
and 2?new, 

9 = Q% d = fidi + od 2 = 9 4 <9, ; d = 0i + 5d 2 . (34) 
Noticing that di = El dj and using (|34|) , we obtain 

; & k E l k - Q l ) d, = (&E k - Q k ) d k = 0, ( V> ! 

thus, 

9 l = (E- 1 ) i k Q k . (36) 



Equation (|36p implies that the components of a vector change controvariantly to the corresponding change of basis. 
As a final remark, notice that 



9 = 9 ,; a = 9 i a 



(E-% & [E k 8 k ] = (E-% E$&d k = 8$&d k = B k d k . (37) 



These preliminary mathematical tools may be extended to the 2Z-dimensional case in a fairly straightforward way. 

B. Diagonalization 

The information metric tensor g (/x, a) in (fT9|) has a matrix representation in the basis 2? id = f {d%, d 2 } given by, 

id (M: cr)] Bold = f 9ij (ft, o-) = ^2 f r 2 ) ' with J = 1 ' 2 ' ( - 38 ' ) 
Since (/x, <r) is symmetric, it is diagonalizable. The eigenvalues are, 

a± (r) d ^ f 3_±VA ^ A = 1 + 4r 2 . (39) 



As a side remark, notice that a_ (r) — > +1 and, a+ (r) — > +2. The eigenvectors 9+ (r) and 9_ (r) corresponding 
to a+ (r) and (r), respectively, are, 

©+ (r) = ( xJvK ) > 6 - W = ( J/A ) ■ ( 4 °) 

Finally, the diagonalized information matrix [g' (/x (fit, a) , a (/x, <r))] s in the new basis B ncw satisfies the following 
relation, 

[g (/x, a)] Boid = E (r) [g' (/x (/x, er) , a (/x, cr))]^ iT 1 (r) , (41) 
where, in an explicit way, we obtain 

W in (fi, *) , o (fi, d ^ f [^~f ,2^)- ^ 

The columns of the matrix E (r) encode the eigenvectors of [g (/x, cr)]g , 9+ (r) and 9_ (r) and it is given by, 
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T , \ def / 1 1 

2r 2r 



It is necessary expressing the pair of macrovariables (/x, cr) in terms of the new statistical variables Jl and a, 

V 0, cr) g' MV (A) cr) ■ 
From differential geometry arguments, it follows that 



(43) 



(44) 



(45) 



Substituting |g3J) in (|45p . we finally obtain the formal relation between the old (/x, cr) and new (/i, tr) set of macrovari- 
ables labelling the macrostates O of our two-dimensional Gaussian statistical model in presence of non-trivial off- 
diagonal terms, 



(46) 



„, def - , . , _s def 1- VA„ 1 + VA „ 

fi [fi, a) = fi + a and, a (p,, a) — — fi H a. 



2r 



2r 



Recall that 6 = O l d t = Q'd, with d t = Efdj and f = (E^ 1 )^ 9 k where E- 1 is the inverse of 03} . Therefore, in our 
case we have 



e 



(E-i)l El + (E-i)l E\] 9^ + \{ET*)\ El + (E-i)l E 



e 1 ^ 



(47) 



e-^ 2 eI + (e-i)Ie$\ e 2 ^ + Ue-^eI + (E-i) 2 2 Ei 



e 2 d 2 . 



Moreover, notice that, 



(El 


E\ \ 




\El 


El) 


■( 



I 1 



2r 2r 



M^T J and > ( ) E -l\l ( E -l 



: (E-^i 



r ( _1 
2r *~ 



2r 



1 



Therefore, substituting (H8l in (|47)) . we obtain 



e = e i a, = with & = e l = (js -1 )' e fc 



(48) 



(49) 



This calculation completes the verification of the correctness of our information geometric diagonalization procedure. 

V. INFORMATION GEOMETRIC COMPLEXITY 

In this Section, we compute the asymptotic temporal behavior of the dynamical complexity of the geodesic trajec- 
tories for the correlated two-dimensional Gaussian statistical model. 



A. Integration of the Geodesic Equations 

After having introduced the diagonalization procedure, the new line element ds 12 (Ji, a) to be considered becomes, 

a - ( r ) j-2 , a + ( r ) 



ds (fj,, cr) = 



a (r)fl + ai (r) a] 2 



dp 1 



[<x (r)/2 + ai (r) a] 2 



db l 



where, 



, . def 3 ± VA def 1 — \/A . . def 1 + \/A . . . . def , , 2 

a± (r) = , a (rj = — , a x (r) = — and, A (r) = 1 + 4r . 



2r 



2r 



(50) 



(51) 
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Notice that ds (fi, a) can be rewritten as, 



ds' (fi, a) 



a_ (7-) 1 



[a\ (r)] cr A. aoM ^\ 

V a x {r) d ) 



As a working hypothesis, we assume that -C 1 for r 3> 1. Stated otherwise, we assume that 



jdji 2 -L- _^-_+1lL_L L 



[ai W] 2 * 2 



f 1 1 a o( r ) A 

1/ Ql (r) «x 



(52) 



lim 

T — »-OC 



Mr) 



<C mm 
re(0,l) 



ai (r) 



mm 

re (0,1) 



1 + Vl + 4r 2 



1 - Vl + 4r 2 



2.6. 



(53) 



Then, in the long time limit, the notion of distinguishability between probability distributions on the diagonalized 
statistical manifold is quantified by the following line clement, 



ds' 2 (fi, a) 



(54) 



After computing the Christoffel connection coefficients arising from (|54|). the set of coupled nonlinear ordinary differ- 
ential equations satisfied by the geodesic trajectories becomes, 



d fi 2 dfi da d a a_ (r) 1 ( djl\ 1 f da 







+ 



dr 2 a dr dr ' dr 2 a+ (r) a \dr J a \dr 



0. 



(55) 



Notice that in the limit of r — * 0, ° H — * \ and the system of equations (|55[) describing the asymptotic behavior of 
maximally probable trajectories on the diagonalized manifold becomes the standard two-dimensional Gaussian system 
of nonlinear coupled ordinary differential equations studied in [16J. In order to further simply the integration of (|55[) . 
consider the following (invertible) change of variables, 



(fi, a) — ► ifi' (fl, d) 



' 2a- (r) . . 

prft 0- (fl, a)=a 

a + ( r ) 



Substituting ([55)1 into ([55]) . the coupled system of nonlinear differential equations to be integrated becomes, 



d 2 p! 2dfi'da' _ Q d 2 a' , 1 fdfi'Y 1 f da' 



dr 2 a' dr dr ' dr 2 ' 2a' V dr 
Integrating (|57|) leads to the following geodesic trajectories, 

1 



a' V dr 



= 0. 



M '(r) = 



4A, a' (r) = 



Sexp (— Ar) 



2A exp (-2Ar) + ^ ' " exp (-2Ar) + 8A , 
where H and A are real and positive constants of integration [Tr| . Using (|46[) and (|56p . we have 



/_*(//, cr') = f 



fi + a and, a (fi , a ) 



, , def 1 - VA / a+ (r) . 1 + VA , 



/2a_(»T ' ' 2r y2a_(r)' 

Notice that our working hypothesis (|53[) is satisfied since we have, 



2r 



lim 



A W _ / «+ (r) /i' (r) 



lim - ex exp (—At) 



0. 



♦00 a (t) V 2a_ (r) t^oo cr' (t) 
Finally, in terms of the original macrovariables (fi, a), the geodesic trajectories finally become, 

H exp( — At) 



(56) 



(57) 



(58) 



(59) 



(60) 



p ( r ; r ) = \/ Stfj 



2 A 



exp(-2A-r) + j 



V ' / 2r V 2a_(r) 



2A 



exp(-2A-r) + j 



4A 



4A 



oxp(-2Ar) + ^ 

l + y/A(r) 5cxp(-Ar) 
2^ cxp(-2AT) + i 



(61) 



In our probabilistic macroscopic approach to dynamics, the geodesic trajectories in (|6ip represent the maximum 
probability paths for the Gaussian statistical model in the presence of correlation-like terms. 
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B. Computation of the Information Geometric Complexity 



In our information geometric approach a relevant quantity that can be useful to study the degree of complex- 
ity characterizing information-constrained dynamical models is the information geometrodynamical entropy <Svi s ( T ) 
(IGE) defined as 0, 



SjK, (t) = f lim logV.M s ( T ) = nm log 



te,{r>) 



dr' 



Vad 2l e 



©*(0) 



(62) 



and g = |det {gp,u)\- IGE is expressed in terms of the information geometric complexity Vm 3 ( t )- It is the asymptotic 
limit of the natural logarithm of the statistical weight defined on the 2Z-dimensional M. s and represents a measure of 
temporal complexity of chaotic dynamical systems whose dynamics is underlined by a curved statistical manifold. In 
our case I = 1 and Vm s (t) becomes, 



/e f {r>) 

V Me (r) = \ J dr 1 | J ^gd 2 Q I , 



0i(O) 



where g (r) — I and 9 (r) = (/i (r; r) , a (r; r) ) given in (|6Tj) . Substituting them into (|63|) , we get, 



(r) 



Sexp (-At) - 4A 



2a_(r) 



exp (— 2Ar) 



l+i/A^)^ 



a+(r) l—y/A(r) 



2r - eX P(- Ar )- 4A \/ 27~TT — 

For the sake of simplicity, let us introduce the following substitutions, 



exp (—2 At) 



dr'. 



a def — def . , 

A = B = -4A< 



2a- (r) 

Then, the integral defining Vm s (r)becomes, 



a+ (r)^gl + 7AH, g_ 4A< 



2r 



1 a + (r) 1 - y/AM 
2a_ (r) 2r 



Vm. (r) 



V^r 2 



dr' 



Ae- Xr ' 



Be 



-2Xt' 



Ce~ XT ' + De~ 2XT 



jdr' 



Upon integration, we get 

Ae Xr ' + Be- 2XT ' 



Ce- Xr ' + De~ 2Xr 
and substituting (f6"T)) into (|66[) . we obtain 



D + Ce 



At' 



De 



At' 



— — t' ^ 

C 



dr'. 



1 /A £ 



T I "77 I In — — -\- — 



C A , 



\\C D DC 



A }_(A_B_ 



V Ms (r) = \/2-r 2 
Introducing again the original parameters in (|65p , we finally get 



In 



C_l 
Dt 



2rV2 



+ 



2rV2 



In E (r, A, a±) 



2ry/2- 



i + VAM [(i + v^F))a 

where the strictly positive function E (r, A, a±) is given by, 

l+yA(r)„ 



(i - Vaw) a 



In E (r, A, a±) 



E (r, A, a±) 



del 



4:/VW 2a-(r) 2r 



> 0, Vr G (0, 1) . 



(63) 



(64) 



(65) 



(66) 



(67) 



(68) 



(69) 



(70) 
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Finally, inserting (|69|) into ([62]) , the IGE Sm„ i T ) becomes, 



Sm s (r; A, r) = log 



2rV2- 



1 + 



2rV2 - r 2 ln£ (r, A, a±) 2rV2 - r 2 In £ (r, A, ay.) 



(l - VAW) A 



(71) 



With a suitable change of notation, equation (|7ip can be rewritten in a more elegant way as follows, 

A 2 (r, A)" 



Sm s (t; A, r) 



log 



Ai (r) + 



(72) 



where, 



Ai (r) 



clef 



2rV2~ 7^ det V(l + 4r 2 )(2-r 2 )lnE(r, A, q±) dcf 3±VT+4^ 

A 2 (r, A) = , a± (r) = . (73) 



1 + Vl + 4r 2 



A 



As stated above, £ (r, A, a±) is a strictly positive function of its arguments. It appears that the introduction 
of additional information constraints (correlations; non-trivial off-diagonal terms) between the macrovariables of the 
Gaussian statistical model leads to the emergence of an asymptotic information geometric compression of the explored 
statistical macrostates on the configuration manifold of the Gaussian statistical model M s in its evolution between the 
initial and final macrostates. This result, thought for a special (not general) case, leads to interesting conclusions. The 
presence of correlations between macroscopic pieces of relevant information on the microscopic degrees of freedom of a 
complex system allows for an information geometric probabilistic description whose complexity, measured in terms of 
$M S (or VM a ), decays in a power law way. Asymptotically, the complexity reaches a saturation value characterized 
solely by the strength of such correlations. The relevance of such results becomes even more clear if compared to what 
happens in absence of correlations We will mention this comparison in our final remarks. 

VI. THE 2Z-DIMENSIONAL MACRO-CORRELATED GAUSSIAN STATISTICAL MODEL 



In this Section, we outline the main steps leading to computation of the asymptotic temporal behavior of the 
dynamical complexity of geodesic trajectories for the correlated 2Z-dimensional Gaussian statistical model. Recall 
that the line element ds 2 = g^ (0) d&'dQ 3 on the 2/-dimensional Gaussian statistical manifold Ai s in the presence 
of non trivial off-diagonal terms is given by, 



a 2 — f 
as M s ~ 



3=1 \ J 3 



2 dfijd<Tj i 2 "".I 



;dai 



with fi, v = 1, 



21. 



(74) 



We consider positive coefficients rj € (0, 1), Vj = 1,..., I. The Fisher-Rao metric tensor (O) 
gij (/i lv ../i ; ; cti,..., ai) leading to the line element in ijTl]) is given by, 



dcf 



[9H m 



21x21 



( M« 2 \ 
-00 
0- 

V M« 2 J 



with i, j = 1, 



21. 



(75) 



where 1S the two-dimensional matrix defined as, 



M 



(fe) 

2x2 



= f — 7t ( ^ I k I with k — 1,..., I. 



(76) 



The inverse matrix 



M. 



(*0 



useful for computing the Christoffcl connection coefficients and other quantities char- 



acterizing the information geometry of M s is given by, 



AI. 



(AO 



dcf <Ji 



2 -r k 
-r k 1 



with k = 1,..., I. 



(77) 
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Following Section III, it can be shown that the Ricci scalar curvature of such 2^-dimensional manifold is given by, 

Km. (ri,..., r ; ) = -2 3 ^(2 



-r 3 



k=l 



Notice that in the limit of vanishing correlation strenghts {rk}, K_m 3 — ~l as shown in [14j . The computation of 
geodesic equations on the 2Z-dimensional Gaussian statistical manifold Ai s leads to the following coupled systems of 
nonlinear second order ordinary differential equations, 



djij. 



4 1 dfi k dcr k 2r k 1 / doj^y _ q 
2 — rf a k dr dr 2 — rf <J k V dr / 



d <J k _i 

"dT 3 " ' 2 



1 J_ ( dp, k Y 
\ dr ) 



(78) 



2r k 1 d fi k da k _ 2 1 ( da k " 
2—r'i <Tk dr dr 2 — r'i cr^ V dr / 



o 



with k — 1,..., I. When r k — * 0, Vfc we get the ordinary Gaussian system of nonlinear and coupled ordinary differential 
equations. Integration of such coupled system of nonlinear second order ordinary differential equations in is highly 
non trivial as pointed out in Section III. However, this problem can be tackled extending the information geomet- 
ric diagonalization procedure introduced in Section IV to the 2Z-dimensional case. The information metric tensor 

g (/i lv ../i;; <7i,..., ai) = f g (0) in (|74[) is symmetric and therefore diagonalizable. The eigenvalues of such matrix are, 

(79) 



a ± (r k ) 3± A (r fc ) = 1 + 4r^, with k = 1,..., I. 



The eigenvectors 0^ = f 0_|_ (r^) and == 0_ (r) corresponding to a+ (rk) and a_ (r^), respectively, are, 



2 



e+ (r fc ) 



l+v^TJ ) and, 6_ (r k ) = ( i-^/aT^TJ J with k = 1,..., I. 



2r, 



2r k 



Following the notation introduced in Section IV, the diagonalized information matrix 
basis B ncw satisfies the following relation, 



g' e e 



e nc . 



(80) 



in the new 



[S(6)] z 



Jf5old -E 2 lxll (' ! '7) 

where, in an explicit way, we obtain 



g' e e 



(n,..., n) [g' (e (e))] g ^ i^ x2; (n,..., r,) 



(81) 



/D (1) 








^ 
























V o 








D (l) j 

-^2x2 / 



(82) 



(k) 

with the two-dimensional diagonal matrices D 2 ^ 2 defined as, 



D 



(fc) 



def 



3+^/A(7- 



with k = I..... I. 



(83) 



The columns of the matrix E21X21 {fi,---, Ti) encode the eigenvectors of [g (0)] B , 0+ and 0_ and is given by, 



[E( ri ,...,n)] 



21x21 



( ^x2 \ 
-00 
0- 
V £#> / 



(84) 



where the two-dimensional matrices £^2 are, 
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E. 



(k) 



del' 



l-y/A(r k ) l+y/Ah) 



(85) 



The relevance of Eiiy.ii (ri,..., n) (and its inverse) is in expressing the set of macrovariables <7i,..., 07) in 

terms of the new statistical variables (/2 lv .., fa; ct 1v .., ctj), 



ffy (Mi>— Mi; ^ij— j ^i) si; (Mi>— > m*; cf-i,— > ^i) 

From differential geometry arguments, it follows that 







f Ml\ 


^2;x2i (n,-, n) 


and, 











/ Mi 



= E 2 i X 2i (rt,..., r k ) 



(86) 



(87) 



V 



Substituting (|85|) in ([87| , we finally obtain the formal relation between the old and new set of macrovariables labelling 
the 2Z-dimensional macrostates of generalized Gaussian statistical model in presence of non-trivial off-diagonal 
terms, 



t~ ~ . - , ,~ - v def 1 - \/A(r k ) . 1 + y/A{r k ) . 

(/x fe , o-fe) = ^ fc +cr fe and, cr(/x fc , cr fe ) = ^t fe H — <r k , with k = 1,..., I. (88) 



2r k 



2r k 



After having introduced the information geometric diagonalization procedure, the new line element 
ds' 2 (Ji x ,..., fa; cti,..., o {) to be considered becomes, 



ds 12 (fa,..., fa; ax,-, &i) = ^ 



fe=i 



a- (rk) 



[a>0 (rfe)Mfe + a i (rfc)crfc] 



"+ (ffc) 



2^fe 

[ao (nc)Mfc + ai (»*fe) o-fe] 



(89) 



where, 



. dof 3 ± 1/A (r*) , . def 1 - V A ( r fe) / n def 1 + v/AW 
a± (r fe ) = , a ir k ) = , a x (r k ) = 



2r k 



2r k 



and, A{r k ) = f l+4r£. (90) 



At this point, omitting additional technical details that are obtainable by just following the work presented in Section 
IV, we are able to compute the asymptotic temporal behavior of the dynamical complexity of geodesic trajectories 
for the correlated 2Z-dimensional Gaussian statistical model. It turns out that, 



$m s (t; {A fc } , {r k }) T ~°° lo g 



k=l 



Ai (r k ) 



A 2 (rfe, Afc) 



(91) 



where, 



Ai (rfe) 



def 2r fev /2 - 



A 2 (rjfe, A fc ) 



def V(l + 4^)(2-^)lnE(r fc , A fel a±) 



rfe 



, a± (rfe) 



(92) 



The quantity £ (r k , Afc, a±) is a strictly positive function of its arguments. For r k = r 8 , Vfc, s = 1,..., /, the information 
geometric entropy Sm, ( r ; ^ A, r) becomes, 



Sm s (t; A, r) r log 



Ai (r) + 



A 2 (r, A) 



(93) 



Therefore, the information geometric complexity presents a power law decay where the power is related to cardinality 
I of the microscopic degrees of freedom characterized by correlated pieces of macroscopic information and it reaches 
a saturation value quantified by the set of {rfc}, the correlation strenghts. 
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VII. CONCLUDING REMARKS 



In this article, we have explored the possibility of describing the macroscopic behavior of complex systems in terms 
of the underlying statistical structure of their microscopic degrees of freedom by the use of statistical inference and 
information geometry. Specifically, we have computed the asymptotic temporal behavior of the dynamical complexity 
of the maximum probability trajectories on 2^-dimensional Gaussian statistical manifolds in presence of correlation- 
like terms between the macrovariables labeling the macrostates of the system. The algorithmic structure of our 
asymptotic computations on curved statistical manifolds is presented in detail for in the two-dimensional case while it 
is outlined for the 2?-dimensional case. Special focus is devoted to the information geometric diagonalization procedure 
that allows to simplify the integration of coupled systems of nonlinear second order ordinary differential equations. 
It appears that the introduction of additional information constraints (correlations) between the macrovariables of 
the Gaussian statistical model leads to the emergence of an asymptotic information geometric compression of the 
explored statistical macrostates on the configuration manifold of the model in its evolution between the initial and 
final macrostates. Actually, the presence of correlations between macroscopic pieces of relevant information on the 
microscopic degrees of freedom of a complex system allows for an information geometric probabilistic description 
whose complexity, measured in terms of 5m s (or Vm s )i decays in a power law way, 



Sm s Cn Ai,..., A ; , n,..., n) 



fc=i 



log 



Ai (r k ) 



A 2 (r fe , A fc ) 



(94) 



Asymptotically, the complexity reaches a saturation value characterized solely by the strength of such correlations. 
The relevance of such results becomes even more clear if compared to what happens in absence of correlations [lil . [l6| , 



S Ms (t; Ai,..., A/) r ~°° ^ log [exp (A fc r)] 



(95) 



fc=i 



In absence of correlations, the information geometric entropy of a 2/-dimensional Gaussian model increases linearly 
in time and its complexity diverges exponentially at a rate determined by {A^}, the Lyapunov exponents of the 
statistical trajectories of the system Q. 

We are confident this work constitutes an important preliminary (testing ground) step towards the computation 
of the asymptotic behavior of the dynamical complexity of microscopically correlated multidimensional Gaussian 
statistical models and other models of relevance in more realistic physical systems. Our ultimate hope is to extend 
this approach in the field ofQuantum Information to better understand the connection between quantum entanglement 
and quantum complexity [13, [H, EH H3] . 
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